AUTOMORPHISMS MAPPING A POINT INTO A SUB VARIETY 



BJORN POONEN 



Abstract. The problem of deciding, given a complex variety X, a point x G X, and a 
subvariety Z C X, whether there is an automorphism of X mapping x into Z is proved 
undecidable. Along the way, we prove the undecidability of a version of Hilbert's tenth 
problem for systems of polynomials over Z defining an affine Q-variety whose projective 
closure is smooth. 



1. Introduction 

Theorem 1.1. There is no algorithm that, given a nice complex variety X , a closed point 
x G X, and a nice subvariety Z C X, decides whether or not there is an automorphism of 
X mapping x into Z . 

Variety means separated scheme of finite type over a field. Nice means smooth, projective, 
and geometrically integral (we will eventually apply this adjective also to varieties over fields 
that are not algebraically closed). Algorithm means Turing machine. So that the input 
admits a finite description, we assume that the input includes a description of a finitely 
generated subfield K of C and that the coefficients of the equations defining X, x, Z are 
elements of K. More precisely, we assume that we are given fi, ■ ■ ■ , f m £ ^[xi, ■ ■ ■ ,x n ] such 
that Z[xi, . . . , x n ]/(fi, . . . , f m ) is a domain with fraction field K, and that elements of K are 
presented as rational expressions in the generators. 

Actually, we show that the problem is undecidable even if X, x, Z are base extensions of 
Q- varieties. In fact, we prove a strong form of Theorem ll.lt 



Theorem 1.2. There is a fixed nice Q-variety X and a fixed rational point x on X such 
that it is impossible to decide which nice Q-subvarieties Z of X meet {ax : a e AutX}. 

That is, there is no algorithm that takes Z as input and decides whether there exists an 
automorphism of X mapping x into Z . 

Finally, our X in Theorem 11.21 will have Aut X = Aut Xq, where Xc is the base extension 
X x Spec C, so it does not matter whether we consider only automorphisms defined over 

SpecQ 

Q or also automorphisms over C. 

These problems are proved undecidable by relating them to Hilbert's tenth problem. 
Hilbert asked for an algorithm to decide, given a multivariable polynomial equation with 
integer coefficients, whether or not it was solvable in integers. But Matiyasevich |Mat70j . 
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building on earlier work of Davis, Putnam, and Robinson [DPR61j . proved that no such 
algorithm exists. 



Remark 1.3. If X is a nice variety of general type, the problems above are decidable because 
Aut X is finite and computable as a subgroup of some PGL n acting on some pluricanonical 
image of X. 

Remark 1.4. This is not the first time that a problem in algebraic geometry has been proved 
undecidable. The problem of deciding whether a rational map of complex varieties X ---> P 2 
admits a rational section is undecidable [KR92J (this is equivalent to the analogue of Hilbert's 
tenth problem for C(T 1 ,T 2 )). The generalization with P 2 replaced by any fixed complex 
variety of dimension at least 2 is undecidable too [Eis04j. (But the analogue for P 1 is still 
open, as is the analogue for any other fixed curve.) 

Remark 1.5. Burt Totaro asked the author in 2007 whether the problem of deciding whether 
two varieties are isomorphic is undecidable. 

2. Lattice automorphisms preserving a finite subset 

The group of affine linear automorphisms of II 1 is the semidirect product GL n (Z) ix Z n , 
with (A, b) acting as x h- > Ax + b. 

Lemma 2.1. For each n > 3, there exists a finite subset S ofE n containing := (0, 0, ... , 0) 
such that the subgroup o/GL n (Z) k Z n mapping S to S equals the subgroup G of linear maps 
given by matrices 

/I a, \ 

1 a 2 



1 a n _i 
a n ) 

with a,i G Z for all i and a n = ±1. 

Proof. Let p^ be the i th prime. For 1 < % < n — 1, let Vi G Z n be the vector with p^ in 
the i th coordinate and elsewhere. Let S = {0, Vi, . . . , v n _i}. Let G' be the subgroup of 
GL n (Z) ix Z n mapping S to itself. Suppose that g G G'. Then g fixes since each other 
vector in S differs from some other vector by a primitive vector. Also g fixes for each i, 
since is distinguished from the other Vj by being divisible by Pi. So g fixes S pointwise. It 
hence acts trivially on the real affine linear span of S, so it acts trivially on Z™" 1 x 0. Thus 
G' C G. Conversely, elements of G map S to S. So G' = G. □ 

3. Blowups of powers of an elliptic curve 

In this section, we prove a weak version of Theorem 11.11 in which Z is not required to be 
smooth or integral. 

Fix an elliptic curve E over Q such that End-E ~ Z and such that E(Q) contains a point 
P of infinite order. For instance, one could take E to the curve labelled 37A1 in |Cre97j . with 
equation y 2 + y = x 3 — x. Let n > 3. Let X be the blowup of E n at the subset S' C (Z • P) n 
corresponding to the subset 5cZ" given by Lemma 12.11 For a variety V, we write Aut V 
for the group of automorphisms of V as a variety without extra structure, even if V is an 
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abelian variety. The birational morphism X — > E n is the map from X to its Albanese torsor, 
so there is an injective homomorphism Aut X — > Aut E n whose image equals the subgroup of 
Aut E n mapping S' to itself. Any such automorphism of E n must be of the form x \— > Ax + b 
for some A G GL n (Z) and b G E n , but S' C (Z ■ P) n so 6 G (Z ■ P) n . It follows that Aut X is 
isomorphic to the group G in Lemma 12.11 Identify the exceptional divisor D above G E n 



with P n 1 in the natural way. Let x = (0 
corresponds to 

/I 



V 



: 1) G P 



n-l 



D C X. If a G Aut A 



1 a 



a 2 
n-l 



G G, 
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let F(ti, 

-l 



t n ) G Z[ti, ...,t n ] be its 



then ax = (a x : • • • : a„) G P™^ 1 . 

Given a polynomial /(ti, . . . , t n -i) £ Z[ti, . . . , t„_i] 
homogenization, and let Z be the zero locus of F in P n_1 — D C. X. Then / has a zero in 
Z™" 1 if and only if F has a zero in Z n_1 x {±1}, which holds if and only if ax G Z for some 
a G Aut A. 

Since the general problem of deciding whether a polynomial in Z[t 1; . . . , i n _i] has an zero 
in Z n_1 is undecidable, the general problem of deciding whether ax G Z for some a G Aut A 
is undecidable too. 



4. Making the subvariety smooth 

Lemma 4.1. There is an algorithm that, given a nonconstant / G Z[xi, . . . , x n ], constructs 
a polynomial F G Z[xi, . . . , x n+ i] suc/i that 

(i) TTie equation f(a) = /ias a solution a E Z n if and only if F{b) = has a solution 
be Z n+1 . 

(ii) The affine variety X := SpecQfxi, . . . ,x n+ i]/(F) is smooth and geometrically inte- 
gral. 

(iii) We have degF = 2deg/. (Here deg denotes total degree.) 

Proof. Consider F(x\, . . . , x n , y) = c(y 2 — y) + f(%i, • • • , x n ) 2 for some c G Z >0 . The values of 
y 2 — y and /(sci, . . . , x n ) 2 on integer inputs are nonnegative, so (i) is satisfied. The singular 
locus S of X is contained in the locus where dF/dy = 0, which is 2y — 1 = in A N . On 
the other hand, Bertini's theorem ( |Har77[ Remark III. 10.9.2]) shows that S is contained in 
y 2 — y = for all but finitely many c. In this case S = 0, so X is smooth over Q. By testing 
c = 1,2,... in turn, we can effectively find the first c for which X is smooth over Q. 

This X is also geometrically integral: since X is isomorphic to a variety of the form 
z 2 — g = for some nonconstant g G Z[xi, . . . ,x n ], if it were not geometrically integral, 
z 2 — g would factor as [z + h)(z — h) for some nonconstant h G Q[xi, . . . , x n ], but then A 
would have to be singular at the common zeros of z and h, a contradiction. □ 

Lemma 4.2. There is an algorithm that, given an affine scheme U of finite type overZ whose 
generic fiber Uq is smooth over Q, constructs n G Z>o and a closed immersion U 
such that the projective closure of the generic fiber Uq in Pq is smooth. 
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Proof. (This proof grew out of a discussion with Andrew Kresch, Florian Pop, and Yuri 
Tschinkel.) Embed U as a closed subscheme of some AJ\ and let X be its closure in P^\ Let 
H = X — U . Resolution of singularities lets us construct a coherent sheaf of ideals Xq on Xq 
with support contained in Hq such that blowing up Xq along Xq yields a smooth Q-scheme. 
Let X := Xq fl Ox in Ox®, so X is a coherent sheaf of ideals on X such that blowing up 
X along X yields X' — > X with X^ smooth over Q. Let E be the exceptional divisor on 
X' . By |EGA II[ 8.1.8], the Cartier divisor —E (corresponding to the invertible sheaf XOx 1 ) 
is ample relative to X' —>■ X. By |EGA II[ 4.4.10(h)], for sufficiently large d, the divisor 
D := dn*H — E on X' is ample and has support equal to the closed subset 7r~ 1 (iJ). So a 
multiple of D determines a closed immersion X' > P^ such that X' H = 7r _1 (£7) ~ £/. 
All these constructions can be made effective. □ 

Combining the previous two lemmas with the negative solution to Hilbert's tenth problem 
yields: 

Corollary 4.3. There is no algorithm that, given f\, . . . , f m G . . . ,x n ] such that the 

projective closure o/SpecQ[ . . . , f m ) in is smooth and geometrically inte- 

gral over Q, decides whether fi(a) = --- = f m (a) = has a solution a G Z™. 

Applying the construction of Section [3] to the smooth projective geometrically integral 
Q- variety Z arising as the projective closure in Corollary 14.31 proves Theorem ll.il 

5. Uniformity 

In this section we prove Theorem II .21 In our proof of Theorem II. 1| the variety X and the 
point x depend only on the integer n chosen at the beginning of Section [31 

The negative solution of Hilbert's tenth problem shows that there are fixed m and d such 
that the problem of deciding whether an m-variable polynomial of total degree d is solvable 
in natural numbers is undecidable [Mat 70] . Replacing each variable by a sum of squares 
of four new variables and applying Lagrange's theorem that every nonnegative integer is 
a sum of four squares shows that the same uniform undecidability holds for solvability in 
integers, provided that we replace (m, d) by (4m, 2d). Combining this with Lemma |4~T1 yields 
undecidability even if we restrict to polynomials defining a smooth affine hypersurface over 
Q, provided that we replace (m, d) by (m + 1, 2d). Because these smooth affine hypersurfaces 
form an algebraic family, the resolution of singularities of each projective closure has bounded 
complexity for all the hypersurfaces in the family, so the proof of Lemma |4~21 re-embeds these 
hypersurfaces in a projective space of bounded dimension, which can then be embedded in 
a larger projective space of fixed dimension D. Finally we may take n = D + 1 in Section [31 
This completes the proof of Theorem 11.21 

Acknowledgements 

It was a discussion with Burt Totaro that inspired the research leading to this article. 
I thank Andrew Kresch, Florian Pop, and Yuri Tschinkel for a teatime discussion at the 
Hausdorff Institute for Mathematics that led to the proof of Lemma 14.21 I thank also 
Laurent Moret-Bailly for a brief suggestion regarding references. 

4 



References 



[Crc97] J. E. Cremona, Algorithms for modular elliptic curves, 2nd ed., Cambridge University Press, Cam- 
bridge, 1997.MR1628193 (99e:11068) flS 

[DPR61] Martin Davis, Hilary Putnam, and Julia Robinson, The decision problem for exponential diophan- 
tine equations, Ann. of Math. (2) 74 (1961), 425-436. MR 0133227 (24 #A3061) H] 

[EGA II] A. Grothendieck, Elements de geometrie algebrique. II. Etude globale elementaire de quelques 
classes de morphismes, Inst. Hautes Etudes Sci. Publ. Math. (1961), no. 8, 222. MR 0217084 
(36 #177b) 1H 

[Eis04] Kirsten Eisentrager, Hilbert's tenth problem for function fields of varieties over C, Int. Math. Res. 
Not. (2004), no. 59, 3191-3205. MR 2097039 (2005h:11273) 1 TTT41 

[Har77] Robin Hartshorne, Algebraic geometry, Springer- Verlag, New York, 1977. Graduate Texts in Math- 
ematics, No. 52.MR0463157 (57 #3116) Id 

[KR92] K. H. Kim and F. W. Roush, Diophantine undecidability ofC(t 1 ,t 2 ), J. Algebra 150 (1992), no. 1, 
35-44. MR 1174886 (93h:03062) t IPl 

[Mat 70] Yu. Matiyasevich, The Diophantineness of enumerable sets, Dokl. Akad. Nauk SSSR 191 (1970), 
279-282 (Russian). MR 0258744 (41 #3390) fOEl 

Department of Mathematics, Massachusetts Institute of Technology, Cambridge, MA 
02139-4307, USA 

E-mail address: poonen@math.mit.edu 
URL: http://math.mit.edu/~poonen 



5 



